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ABSTRACT 



A method and an apparatus for verifying a multiplexing 
schedule of digital signals and an apparatus for multiplexing 
the digital signals are provided. The verifying method 
includes the processes of extracting access unit information 
about each decoding unit from each elementary stream of 
the digital signal, determining schedule information about 
time division of each elementary stream, based on the access 
unit information, and verifying whether or not the multi- 
plexing schedule for generating the multiplexed stream is 
valid, based on the access unit information and the schedule 
information. The verifying apparatus includes an extracting 
section for extracting access unit information about a decod- 
ing unit from each elementary stream of the digital signal, a 
determining section for determining schedule information 
about time division of the elementary stream, based on the 
access unit information, and a verifying section for verifying 
whether or not the muhiplexing schedule for generating the 
multiplexed stream is valid, based on the access unit infor- 
mation and the schedule information. 

4 Claims, 8 Drawing Sheets 
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METHOD AND APPARATUS FOR 
VERIFYING MULTIPLEXING SCHEDULE 
OF DIGITAL SIGNALS AND APPARATUS 
FOR MULTIPLEXING DIGITAL SIGNALS 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The present invention relates to a method and an appa- 
ratus for verifying a multiplexing schedule of digital signals 
which are suitable to scheduling executed when multiplex- 
ing the digital signals, and an apparatus for multiplexing 
digital signals. 

2. Description of the Related Art 

Today, an image signal and a speech signal are com- 
pressed according to the MPEG (Moving PicUire Coding 
Experts Group) standards compressing system. Then, the 
compressed signals (elementary streams) compose a multi- 
plexed stream. The multiplexed stream is recorded on a 
recording medium E^irther, a multiplexed stream recorded 
on the recording medium is reproduced by a reproducing 
apparatus so that the multiplexed stream may be separated 
into the original elementary streams, from each of which the 
image signal and the speech signal are decoded. 

The method for separating the multiplexed stream into 
elementary streams is regulated according to the ISO 
(International Organization for Standardization) 13818-1 or 
11172-1, for example. This separating method employs an 
ideal decoder and is termed a STD (System Target Decoder) 
model. 

The time-divisional multiplexed elementary streams are 
applied to the STD model. The multiplexed stream is applied 
to the STD model at regular times by decoding a clock 
reference that is encoded time information (termed SCR: 
System Clock Reference). 

The multiplexed stream applied to the STD model is 
divided into the elementary streams by a switch 100 as 
shown in FIG. 1. Those elementary streams are supplied to 
the corresponding bufifers 101 to 104. 

The rate information encoded in the multiplexed stream 
(termed MUX_rate) is supplied to the buffers selected by 
the switch. The input to the buffer not selected by the switch 
100 is 0. 

The elementary stream is pulled out of the btiffer at each 
access unit that is a decoding unit defined for each elemen- 
tary stream. At a decoding time of the access unit that is 
another piece of time information encoded in the stream, the 
data of the access unit is instantly pulled out of the buffer and 
then is supplied to the decoders 106 to 109. This decoding 
time guarantees the synchronization among the elementary 
streams. 

For example, for the so-called I picture or P picture, the 
video data decoded by the decoder 106 is output through a 
reorder buffer 110, a selected terminal, and a switch 111. For 
the so-called B picture, the video data is output through 
another selected terminal and the switch 111. The other data 
such as the audio data and the subtitle data decoded by the 
decoders 107 to 109 are directly output. 

The time-divisional multiplexing scheduling is executed 
without overflowing or underflowing the buffers 101 to 104. 
Further, the proper clock reference is required to be encoded 
in the multiplexed stream. 

As shown in FIGS. 2A and 2B, the multiplexed stream is 
composed of packets, each packet containing the data of the 
single elementary stream. The set of the packets composes 
a pack. The size of the packet or the pack is optional and is 
ordinarily determined according to a transmission/storage 
medium. 
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The pack header contains the SCR that is the reference 

time of the STD and the MUX rate encoded therein as 

additional information. The input rate to the STD model may 
be variable for each pack according to the MUX_rale 

5 encoded on the pack header. Further, the packet header 
contains time points when the following access units are 
decoded (termed a DTS Decoding Time stamp) encoded 
therein. The STD model is executed to reset an internal clock 
(termed an STC: System Time Clock) to the SCR when the 

10 SCR is input to the model. The SCR is required to be 
inserted to the STD model at intervals of 0.7 sec or shorter. 

As shown in FIG. 2C, assume that the input of the 
multiplexed stream to the STD model is executed at the 
MUX_rate. When the STD model reads the SCRl as a value 

^5 of the SCR inside of the pack header, the STD model serves 
to set the STC to a value of the SCRl. When the STC is 
counted up to the same value of the SCRl, the STD model 
starts to read the data ESI to the buffer 101 and continues to 
read the data ESI until all data is read out of the packet. 

20 When the STD model reads the DTSl as a value of the DTS, 
as shown in FIG. 2D, the data of the access units stored in 
the buffer 101 is pulled out at a time point indicated by the 
DTSl. 

On the other hand, the buffer 102 is served to read the data 
ES2 when the STC value is counted up to the value of the 
SCR2, for example. When the STD model reads the DTS2, 
as shown in FIG. 2E, at the time point indicated by the 
DTS2, the data of the access units stored in the buffer 102 
is pulled out. 

30 

At this tmie, the amount of the data occupying each buffer 
is equal to or smaller than a buffer size and the data of the 
access units decoded at the decoding time point have been 
already applied in the buffer. Hence, the multiplexing sched- 

25 ule is considered proper. 

However, if the amount of data occupying the buffer is too 
larger or too small, the buffer may be broken. 

For example, and with reference to FIGS. 3A-3E 
(wherein FIGS. 3A-3C are substantially identical to FIGS. 

40 2A-2C and, in the interest of brevity, are not described 
again), if the amount of data occupying the buffer exceeds 
a given buffer size, the overflow takes place in the buffer. As 
shown in FIG. 3D, the buffer 101 is overflown while the 
packet (n, 1) is being input. The schedule in which the packet 

45 (n, 1) multiplexes the data ESI does not satisfy the STD 
model. 

On the other hand, as shown in FIG. 3E, for the data ES2, 
the data of the access units decoded at the decoding time 
points are not still completely applied to the buffer. This is 
50 an underflow of the bxiffer 102. The schedule in which the 
packet (n, 2) multiplexes the data ES2 is considered erro- 
neous. 

As mentioned above, in a case of executing the multi- 
plexing schedule, it is essential to verify whether or not the 
multiplexed stream generated as a result of the schedule 
meets the STD model. 

In order to verify whether or not the multiplexed stream 
meets the STD model, it is necessary to grasp the size and 
the decoding time point of the access unit and simulate the 
I/O operation of the buffer. 

For the JSCs 13818-1 and 11172-1, the conditions the 
multiplexed stream meets are as follows. 

The data does not stay within the buffer for one second or 
65 longer (one-second rule). 

Less than 31 access units are allowed to be put in the 
buffer. 
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The verification is executed at each slit and the DTS divisional multiplexed stream from elementary streams of 

(decoding time point). plural digital signals, includes the steps of: extracting access 

The slit between the access units is identified by the start unit information about a decoding unit from each elementary 

code for indicating the start of the start unit. For example, stream; determining schedule information about time divi- 
the access unit of the image signal encoded by the ISOs 5 sion of each elementary stream, based on the access unit 

13818-2 and 11172-2 is started at a four-byte start code. information; and verifying whether or not the multiplexing 

For the method for detecting a slit between the access schedule for generating the multiplexed stream is valid, 

units from the data input to the buffer, there has been based on the access unit information and the schedule 

proposed a method for decoding the compressed data and information. 

detecting an end of the access unit and a method for . „ j ^ *u ■ ^ — «u j 

, , . ^ , , J - ^. „ • .t. • » J * According to a second aspect of the mvention, a method 

detectmg a start code of the access unit in the mput data. - r • i^- 1 • l j 1 i? 

_ , . , ^ , , , - 1 , . tor veriiying a multiplexing schedude tor genera tine a timc- 

By the way, both of these methods are reGUu*ed to check j - • • t ™ u,* 1^ j ♦ ™ <^ ™ 1 ™ ♦ * r 

r 11 J . . . . . ^1. i_ rc J 1 divisional multiplexed stream from elementary streams 01 

for all data to be mput to the buffer and consume long time. , 1 j- 1 • 1 • 1 j .1. * c . 

Further, the method for actually decoding all data needs an Pl"[^ digital signals, inchides the steps of: extracting access 

additional processing cost because the decoding is required. „ information about a decoding unit from each elementaiy 

On the other hand, in the method for detecting the start «f ^""^ extractmg schedule information &om the mulh- 

code, as shown in FIG. 4A, at the outset, the start codes are ^l"""^^ ^^'^'^ generated by tune-divisionally multqikxing 

located seriaUy on the elementary stream. As to the data the elemeatary stream; and, verifying whether or not the 

divided into packets according to the multiplexing schedule, °"""P^»°g schedule for generating the multiplexed stream 

, . ^ i_ J- J J IS valid, based on the access umt information and the 

as shown m FIG. 4B, the access unit may be divided mto one u h 1 * f ♦* "iL^nxiatiuii 

or more packets. Then, the stream time^iivisionally multi- scnedule inlormation. 

plexed with tiie data of another elementary stream based on According to a third aspea of the invention, an apparatus 
the multiplexing schedule is arranged so that the divided ^r verifying a multiplexing schedule for generating time- 
access units are multiplexed at remote locations as shown in divisional multiplexed stream from elementary streams of 
FIG. 4C. plural digital signals, includes: an extracting section for 
Concretely, as shown in FIG. 4C, it is impossible to know extracting access unit information about a decoding unit 
an end All of the previous access unit until a All time point ^^^^ elementary unit; a determining section for deter- 
when the start code is detected. Hence, it is necessary to ^^^^^^^ information about time division of the 
verify the schedule after the verifying process is returned elementary stream, based on the access unit information; 
from the time point when All is detected to the time point 30 ^ verifying section for venfymg whether or not the 
when All is input multiplexing schedule for generating the multiplexed stream 

c„^u«, :„ « tu^ tu^ tu^ ^ valid based on the access unit information and the 

further, in a case that on the Lll, the end 01 the access 1, h 1 ' f 

unit coincides with the end of the packet, until the start code sctiedule intormation. 

is detected on the Dll, it is impossible to determine that CU According to a fourth aspect of the invention, an appa- 
is the end of the access unit. 35 for multiplexing digital signals, for generating a time- 
In a case ±at a decode of the access unit takes place divisional multiplexed stream from elementary streams of 
between the Cll and the Dll, since the size of the access P^"""^ ^^^^^ signals, includes: an extracting section for 
unitisunknown,itisimpossibletoverifythepuUofthedata extracting access unit information about a decoding unit 
from the buffer. For verifying it, therefore, the verifying ^^"^ ^.^^^^ elementary stream; a determmmg section for 
process is required from when the Dll is detected back to 40 determining schedule mformation about time division of the 
when the Cll is input. In other words, it is necessary to elementary stream, based on the access umt information; a 
pre-read the data until the next access unit start is detected. generatmg section for generating the multiplexed stream, 
Hiat is, for verifying whether or not the multiplexed ^'^/^^ ^^^^ elementary stream, the access unit 
stream meets the STD model, it is necessary to actually ^iorm^^^on. and the schedule information; and a verifying 
decode the data and pre-read the data until the start of the 45 ^^^l^y^^g whether or not the mulUplexmg sched- 
next access unit is detected. generatmg the multiplexed stream is vabd, based on 

.u 1-1010 1 J1HT11 *i- 1 t the access unit information and the schedule information. 

For the ISOs 13818-1 and 11172-1, the maximum value of 

the interval between the timestamps of the SCR is deter- According to a fifth aspect of the invention, an apparatus 

mined as the conditions the multiplexed stream should meet. multiplexing digital signals, for generatmg a time- 
Taking an example of the SCR, for verifying the interval 50 divisional multiplexed stream from elementary streams of 

between the serial SCRs with the multiplexed stream as an P^^^^^ ^^S^^^ ^g^^' includes: an extracting section for 

input, the start code of the pack header is detected in the data extractmg access unit mformaUon about a decoding unit 

input to the STD model, and it is necessary to actually puU ^^"^ ^.^^^ elementary stream; a generating section for 

out of the field of the SCR encoded in the pack header These determinmg schedule mformation about time division of 
operations are quite inconvenient. 55 each elementary stream based on the access unit mformation 

TTie present invention is considered in the foregoing and generating time-divisional multiplexed stream based on 

conditions, and it is an object of the present invention to each elementary stream, the access umt information, and the 

provide a method and an apparatus for verifying a multi- schedule mformation; an extracting section for extracting 

plexing schedule of digital signals and an apparatus for ^^^^^^ information from the time-div^ional multi- 
multiplexing the digital signals Ihich are arranged to verify 60 Plexcd stream; and a verifying section for venfymg whether 

the multiplexing schedule without having to actually decode °[ multiplexing schedule for generatmg the multi- 

the data and pre-read the data until the start of the next P^^?^^^ ^ ^^^^ ^^^^ "^^^ mfomiation 

access unit is detected. ^^^^^^^ information. 

Further objects and advantages of the present invention 

SUMMARY OF THE INVENTION apparent from the following description of the 

According to a first aspect of the invention, a method for preferred embodiments of the invention as illustrated in the 

verifying a multiplexing schedule for generating a time- accompanying drawings. 
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BRIEF DESCRIPTION OF THE DRAWINGS frame rate of the elementary stream and the repeat_first_ 

field/picture_coding_type of the access unit are known. 

Further features, advantages and charactenslics of the repeat_Jrst_field is a flag indicating a repetiUvely 

invention arc explained in the following with reference to displayed redundant field. The picture_coding_type is a 

the drawings, in which: ^ flag indicating an encoding type of the picture. 

FIG. 1 is a block diagram showing the so-called STD The storage medium 3 stores the access unit information 

model; from the pre-processing section 2 and then supplies the 

FIGS. 2A to 2E arc views showing relation between a information to the scheduler 4 as well as the verifying 

multiplexed stream supplied to the STD model and an section 8. 

amount of data occupying a buffer of the STD model; lo The scheduler 4 determines the time-divisionally multi- 

r-i^o A . -^r- • L • 1.- t J . plexing schedule on the information of the access unit. This 

FIGS. 3A to 3E views showing a mulUplexed stream ^^^^^^^ ^ determined so that the overflow of the data is 

supphed to the STD model and a state where a buffer is ^^^.^^^ ^ ^ ^^^^ monitoring the data occupying 

broken by the data occupying a buffer of the STD model; amount of the buffer provided in the decoder. Concretely, the 

FIGS. 4A to 4C are views showing splits appearing when schedule information determined herein contains a size of a 

the multiplexed stream is generated by dividing the elemen- pack header about a pack, a SCR (System Clock Reference) 

tary stream into access units; which is a reference value of a reference clock owned by the 

FIG. 5 is a block diagram showing an arrangement of an STD model, and rate information (termed MUX_rate). The 

apparatus for multiplexing digital signals to which a method schedule information about a packet contains a packet type, 

for verifying a multiplexing schedule of digital signals ^ P^^^ "^^^^ following access unit is decoded 

according to the present invention is applied; (termed DTS: Decoding Time Stamp), a size of a header, and 

FIG. 6 is a view showing a composition of a multiplexed ^ ^^^^ ^ packet, 

stream generated by the apparatus for multiplexing the storage medium 5 stores the schedule information 

digital signals- scheduler 4 and supplies the schedule information 

FIG. 7 is J flowchart showing a concrete process for 25 the multiplexed data generating section 6 as weU as the 

verifying the multiplexing schedule of the digital signals; veritying section 8. 

^jjjj The multiplexed data generatmg section 6 operates to 

™^o- LiTj- i_- divide the plural elementary streams and supply one multi- 

FIG 8 IS a block diagram showing an apparatus for ^^^/^ ^ the multiplexed data 

multiplexing the digital signals according to another ^ . . , , 

embodiment of the present invention. 30 The multiplexed stream generated as described above as 

shown in rlCi. 6, is lormed by time -division ally multiplex - 

DESCRIPTION OF THE PREFERRED "'S the elementary streams and is composed of packets. 

EMBODIMENTS ^^^^ packet is consistently composed of a single elementary 

stream, which never contains the data of another elementary 

Hereafter, the description will be oriented to verification stream. Each packet is accompanied with the packet head, 

for multiplexing schedule of digital signals according to the ^^^^^ ^^^^^^ contains the information indicating the 

present invention along the appended drawings. The present content of the packet, the DTS, and the PTS (Presentation 

invention may be suitably applied to verifying the validity j^^^ gt^mp). The DTS and the FTS may be described at an 

about a multiplexing schedule such as an occupying amount access unit. The DTS indicates the time point when the 

of a decoder buffer and a time management of a decoder for corresponding access unit is pulled out of each buffer in the 

synchronously reproducing elementary streams of the time- s^D model. The PTS indicates a decoding time point and a 

divisionally multiplexed digital signals. ^^^^i^y time point when the corresponding access unit is 

The apparatus for multiplexing the digital signals to pulled out of each buffer in the STD model. The interaa- 

which the present invention applies includes a pre- tional Standards ISO 11172-3 for compressing a speech 

processing section 2 for pre-processing elementary streams ^5 signal keeps the time points of the DTS and the PTS 

stored in a storage medium 1, a storage medium 3 for storing identical with each other. Hence, on the multiplexed stream, 

access unit information supplied from the pre-processing only the PTS value is described. Further, the SCR is a 

section 2, a scheduler 4 for determining a time-divisionally reference value for a reference clock owned by the STD 

multiplexing schedule on the basis of the access unit infor- model and is described in the pack header. When the SCR is 

mation from the storage medium 3, a storage medium 5 for handled, it is possible to read the multiplexed stream on the 

storing schedule infonaaation from the scheduler 4, and a decoding side and control the input of the data through each 

multiplexed data processing section 6 for generating multi- buffer. The size of the packet is in general variable. The 

plexed streams on the basis of the elementary streams from information about the size is contained in the packet header, 

the storage mediums 1, 3 and 5. On the other hand, the verifying section 8 is able to 

The storage medium 1 stores the elementary streams to be 55 simulate the transition of an occupation amount of the buffer 

multiplexed and then supplies these elementary streams to on the basis of the access unit information from the storage 

the pre-processing section 2 as well as the multiplexed data medium and the schedule information from the storage 

generating section 6. medium 5 obtained in the multiplexing process, without 

The pre-processing section 2 receives the supply of the having to actually process the multiplexed stream, 

elementary streams from the storage medium 1 and extracts 60 That is, the determination of the time-divisional multi- 

the access unit information from those elementary streams. plexing schedule leads to the determination of the afore- 

This access unit information is composed of a access unit mentioned schedule information. Only if the information 

size and a decoding time point. The information about the corresponding to the multiplexing history is kept output, the 

decoding time point is a decoding time point itself or the verifying process does not need the actual multiplexed data, 

data required for calculating the decoding time point. For 65 Further, only based on the schedule information, it is pos- 

example, the decoding time point may be derived from the sible to easily verify wether or not the limitation of the 

image data encoded according to the ISO 13818-2 if the interval between the adjacent timestamps is observed. 
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The multiplexing schedule of the multiplexed stream 
generated as above is verified by the apparatus for verifying 
the multiplexing schedule of the digital signals including the 
pre-processing section 2, the scheduler 4) and the verifying 
section 8. 5 

That is, if the access unit information and the schedule 
information are prepared by the pre-processing section 2 and 
the scheduler 4, the verifying section 8 executes the opera- 
tion of the flowchart shown in FIG, 7. In the flowchart, 
proceeding to a step SI, the schedule information of the pack 
is read. Then, the verifying section 8 checks if the interval 
of the SCR is 0.7 second or lower. Then, the operation goes 
to a step S2. 

At the step S2, the verifying section 8 compares the recent 
decoding time point with the input end time point of the 
packet header. When the pack header is input, the start of the 
decoding is determined. Then, the operation goes to a step 
S3. 

At the step S3, the verifying section 8 operates to reduce 
the size of the access unit to be decoded from the occupation 
amount of the corresponding buffer. The verifying section 8 
operates to check the size of the access unit not to cause the 
underflow of the access unit. The verifying section 8 selects 
the next decoding time point and then returns to the step S2. 

On the other hand, if, at the step S3, it is determined that 
no decoding is brought about when the pack header is input, 
the operation goes to a step 84. At this step, the verifying 
section 8 determines whether or not the current pack is 
terminated. On the termination, the operation goes to a step 
SI. If the next access unit information and schedule infor- 
mation are prepared, the operation after the step SI is 
executed. On the other hand, unless the next access unit 
information and schedule information are prepared, no 
operation after the step SI is executed. Without terminating 
the current pack, when the packet is left in the current pack, 
the operation goes to a step S5. At the step S5, the verifying 
section 8 reads the pack schedule information, and then the 
operation goes to a step S6. 

At the step S8, the verifying section 8 processes the recent 
one to the current time point. That is, when the verifying 
section 8 determines that the next decoding is close to the 
current time point, that is, the possibility of causing under- 
flow is high, the operation goes to a step 87, 

At the step S7, the verifying section 8 operates to add the 
packet data amount input until the decoding time point to the 
occupation amount of the corresponding buffer. At this time, 
the verifying section 8 operates to check the packet data 
amount not to cause the overflow of the packet data. Then, 
the operation goes to a step 88. 

At the step 88, the verifying section 8 operates to reduce 50 
the size of the access unit to be decoded from the occupation 
amount of the corresponding buffer. At this time, the veri- 
fying section 8 checks the size of the access unit not to cause 
the underflow of the packet data. Then, the operation goes to 
a step S6. 55 

On the other hand, at the step S6, when the verifying 
section 8 determines that the start of inputting the next 
access unit is close to the current time point, the operation 
goes to a step S9. At this step, the verifying section 8 checks 
whether or not the time between the time point when the 60 
input of the access unit is started and the time point when the 
access unit is decoded is within one second (one-second 
rule). Then, the verifying section 8 checks whether or not the 
number of access units in the buffer is equal to or lower than 
the limited value. The operation goes to a step S6. 65 

When, at the step S6, the verifying section 8 determines 
the input of the current packet is close to the current time 
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point, that is, the data is further suppUed to the buffer, the 
operation goes to a step SIO. At this step, the verifying 
section 8 operates to add the remaining packet data to the 
occupation amount of the corresponding buffer. At this time, 
the verifying section 8 checks the packet data not to cause 
the overflow of the packet data. Then, the operations returns 
to the step S4. 

As set forth above, in the verification for the multiplexing 
schedule of the digital signals, the schedule for the multi- 
plexed stream is easily executed by using the access unit 
information and the schedule information without actually 
encoding the data. 

Next, the description will be oriented to the second 
embodiment of the present invention. The same components 
of the second embodiment as those of the first embodiment 
have the same reference nimibers. The description about the 
same components is left out. 

The apparatus for multiplexing the digital signals accord- 
ing to the second embodiment of the present invention, as 
shown in FIG. 8, includes a pre-processing section 2 for 
pre-processing the elementary stream stored in the storage 
medium 3 1, a storage medium for storing the access unit 
information supplied from the pre-processing section 2, a 
scheduler and multiplexed data generating section 4 for 
determining the schedule for time-divisional muUiplexing 
on the basis of the access unit information supplied from the 
storage medium 3 and generating the multiplexed stream, a 
storage medium 7 for storing tiie multiplexed stream from 
the scheduler and multiplexed data generating section 4, and 
a verifying section 8 for verifying the midtiplexing schedule 
on the basis of the data from the storage mediums 3 and 7. 

According to this embodiment of the invention, the veri- 
fying section 8 receives the actual multiplexed stream and 
the access imit information and verifies the multiplexing 
schedule indicated at the steps SI to SIO of the flowchart 
shown in FIG. 7 on the basis of the information. The 
schedule information is extracted from the pack header and 
the packet header of the multiplexed stream. 

That is, the verifying method is arranged to skip the data 
portion of the packet input to flie buffer of the STD model 
by using the access unit information without having to 
actually process the multiplexed data. Hence, the verifying 
method with the access unit information greatly reduces its 
processing time and facility cost as compared with the 
method with no access unit information. 

As set forth above, the method for verifying the multi- 
plexing schedule of the digital signals according to the 
present invention is arranged to extract each piece of access 
unit information from each elementary stream, determine 
the schedule information of the multiplexed stream formed 
by time-divisionally multiplexing each elementary stream 
on each piece of access unit information, and verify the 
validity of the multiplexing schedule of the multiplexed 
stream on the basis of these access unit information and 
schedule information. That is, if no multiplexed stream to be 
verified is left, the verifying method does not need to decode 
the packet data of the multiplexed stream for checking it, 
resulting in greatly reducing the verifying time and the 
facility cost. 

Further, the apparatus for verifying the multiplexing 
schedule of the digital signals according to the present 
invention is arranged to extract the access unit information 
and the schedule information about the decoding unit infor- 
mation obtained from the elementary stream when generat- 
ing the multiplexed stream. The apparatus enables to verify 
whether or not the multiplexing schedule of the multiplexed 
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Stream is valid without actually decoding the generated 
multiplexed stream and thereby reduce the verifying time 
and the facility cost for the verification. 

The apparatus for verifying the multiplexing schedule of 
the digital signals according to the present invention is 
arranged to extract the access unit information about each 
decoding unit obtained in generating the multiplexed stream 
and extract the schedule information from the generated 
muhiplexed stream for verifying whether or not the multi- 
plexing schedule of the multiplexed stream is valid. That is, 
the verifying apparatus enables to reduce the verifying time 
and the facility cost for the verification without having to 
actually decode the generated multiplexed stream. 

The apparatus for multiplexing the digital signals accord- 
ing to the present invention provides a capability of gener- 
ating the multiplexed stream firom each elementary stream 
and verifying whether or not the multiplexing schedule of 
the multiplexed stream is valid on the basis of the access unit 
information and the schedule information obtained in gen- 
erating the multiplexed stream. That is, the apparatus for 
multiplexing the digital signals enables to make sure that the 
multiplexing schedule is vaUd without having to actually 
decode the generated multiplexed stream and contribute to 
reducing the verifying time and the facility cost for the 
verification. 

The apparatus for multiplexing the digital signals accord- 
ing to the present invention provides a capability of gener- 
ating the multiplexed stream from each elementary stream 
and verify whether or not the multiplexing schedule of the 
muhiplexing stream is valid on the basis of the access unit 
information obtained in generating the multiplexed stream 
and the schedule information extracted from the generated 
multiplexed stream. That is, the apparatus for multiplexing 
the digital signals enables to verify whether or not the 
schedule is valid without having to actually decode the 
generated multiplexed stream by extracting only the sched- 
ule information of the generated multiplexed stream and 
thereby contribute to reducing the verifying lime and the 
facility cost for the verification. 

Many widely different embodiments of the present inven- 
tion may be constructed without departing from the spirit 
and scope of the present invention. It should be understood 
that the present invention is not limited to the specific 
embodiments described in the specification, except as 
defined in the appended claims. 

What is claimed is: 

1. A method for verifying the validity of a multiplexing 
schedule for generating a time -divisional multiplexed 
stream comprised of a sequence of access imits each being 
assigned a plurality of data packets multiplexed from a 
plurality of elementary streams of compressed digital 
signals, comprising the steps of: 

determining access unit information about the assignment 
of said plurality of data packets to respective access 
units; 

determining schedule information about the multiplexing 
of said elementary streams, based on said access unit 
information; and 

verifying the validity of the multiplexing schedule based 
on the access unit information and the schedule infor- 
mation to determine whether, upon demultiplexing and 
decoding, it is possible for the elementary streams to be 
synchronously reproduced by a decoder on the basis of 
whether a decoder buffer will overflow or underflow. 

2. A method for verifying the validity of a multiplexing 
schedule for generating a time-divisional multiplexed 
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stream comprised of a sequence of access units each being 
assigned a plurality of data packets multiplexed from a 
plurality of elementary streams of compressed digital 
signals, comprising the steps of: 

determining access unit information about the assigrunent 

of said plurality of data packets to respective access 

units; 

determining a schedule information for time-divisionally 
multiplexing said plurafity of elementary streams and 
generating said multiplexed stream according to said 
access unit information and said schedule information; 

extracting said schedule information from said multi- 
plexed stream; and 

verifying the validity of the multiplexing based on the 
access unit information and the schedule information to 
determine whether, upon demultiplexing and decoding, 
it is possible for the elementary streams to be synchro- 
nously reproduced by a decoder on the basis of whether 
a decoder buffer will overflow or underflow. 

3. Ad apparatus for verifying the validity of a multiplex- 
ing schedule for generating a time-divisional multiplexed 
stream comprised of a sequence of access units each being 
assigned a plurality of data packets multiplexed from a 
plurality of elementary streams of compressed digital 
signals, comprising: 

a preprocessor for determining access unit information 
about the assignment of said plurality of data packets to 
respective access units; 

a determining section for determining schedule informa- 
tion about the multiplexing of said elementary streams, 
based on said access unit information; and 

a verifying section for verifying the validity of the mul- 
tiplexing schedule based on said access unit informa- 
tion and said schedule information to determine 
whether, upon demultiplexing and decoding, it is pos- 
sible for the elementary streams to be synchronously 
reproduced by a decoder on the basis of whether a 
decoder buffer wiU overflow or underflow. 

4. An apparatus for verifying the validity of a multiplex- 
ing schedule for generating a lime-divisional multiplexed 
stream comprised of a sequence of access units each being 
assigned a plurality of data packets multiplexed from a 
plurality of elementary streams of compressed digital 
signals, comprising the steps of: 

a preprocessor for determining access unit information 
about the assignment of said plurality of data packets to 
respeaive access units; 

a generating section for determining a schedule informa- 
tion for time-divisionally multiplexing said plurality of 
elementary streams and for generating said miiltiplexed 
stream according to said access unit information and 
said schedule information; 

an extracting section for extracting said schedtile infor- 
mation from said multiplexed stream; and 

a verifying section for verifying the validity of the mul- 
tiplexing schedule based on said access unit informa- 
tion and said schedule information to determine 
whether, upon demultiplexing and decoding, it is pos- 
sible for the elementary streams to be synchronously 
reproduced by a decoder on the basis of whether a 
decoder buffer will overflow or underflow. 
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